Papers with ROUGE-L score
Distantly Supervised Aspect Clustering And Naming For E-Commerce Reviews (2022.naacl-industry)
Copied to clipboard
| Challenge: | Product aspect extraction from reviews is a critical task for e-commerce services . scale of reviews makes human review at ecommerce scale infeasible. |
| Approach: | They propose automated methods for extracting aspect phrases from reviews . they train transformer based sentence embeddings that are aware of unique e-commerce language characteristics . |
| Outcome: | The proposed method improves the Silhouette Score by 64% compared to the state-of-the-art model . human review at e-commerce scale is infeasible due to the scale of the reviews . |
DETQUS: Decomposition-Enhanced Transformers for QUery-focused Summarization (2025.naacl-long)
Copied to clipboard
Yasir Khan, Xinlei Wu, Sangpil Youm, Justin Ho, Aryaan Mehboob Shaikh, Jairo Garciga, Rohan Sharma, Bonnie J Dorr
| Challenge: | Query-focused tabular summarization is an emerging task in table-to-text generation . traditional transformer-based approaches face challenges due to token limitations and the complexity of reasoning over large tables. |
| Approach: | They propose a system that leverages tabular decomposition alongside a fine-tuned encoder-decoder model to improve summarization accuracy. |
| Outcome: | a new system outperforms the state-of-the-art REFACTOR model in a Query-focused tabular summarization task . the proposed system achieves a ROUGE-L score of 0.4437, outperforming the previous state- of-the art model . |
Sign Language Production With Avatar Layering: A Critical Use Case over Rare Words (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing vision-based sign language production approaches suffer from out-of-vocabulary (OOV) and test-time generalization problems. |
| Approach: | They propose an avatar-based sign language production system that generates sign language videos from spoken language expressions. |
| Outcome: | The proposed system achieves higher BLEU-4 and higher ROUGE-L scores on a new Korean-Korean sign language dataset. |
A Multi-answer Multi-task Framework for Real-world Machine Reading Comprehension (D18-1)
Copied to clipboard
| Challenge: | Existing models of machine reading comprehension (MRC) are based on cloze style questions or crowdworkers given a short passage from well-edited sources. |
| Approach: | They propose a multi-answer multi-task framework that uses multiple reference answers for multiple questions. |
| Outcome: | The proposed model increases the ROUGE-L score on the DuReader dataset from 44.18, the previous state-of-the-art, to 51.09 . |
Controllable Abstractive Dialogue Summarization with Sketch Supervision (2021.findings-acl)
Copied to clipboard
| Challenge: | Using a model to generate summary sketches, we improve abstractive dialogue summarization quality and enable granularity control. |
| Approach: | They propose a model that generates a preliminary summary sketch and a strategy to control granularity. |
| Outcome: | The proposed model achieves state-of-the-art on the largest dialogue summarization corpus with as high as 50.79 in ROUGE-L score. |
Why Does Zero-Shot Cross-Lingual Generation Fail? An Explanation and a Solution (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on cross-lingual transferability of multilingual LMs show that they can perform tasks in low-resource languages. |
| Approach: | They propose a method to regularize the model from learning language invariant representations and a way to select model checkpoints without a development set in the target language. |
| Outcome: | The proposed method reduces the accidental translation problem by 68% and improves the ROUGE-L score by 1.5 on average. |